Search AI Products and News

Alibaba's Tongyi Lab recently released a new digital human video generation model called "OmniTalker." This innovative model allows for precise imitation of a person's expressions, voice, and speaking style by simply uploading a reference video. Compared to traditional digital human production workflows, OmniTalker significantly reduces production costs while enhancing the realism and interactive experience of the generated content, meeting a wide range of application needs. OmniTalker is easy to use; users only need to...

Recently, an innovative technology named LHM (Large-scale Human Model for Animation) has achieved a significant breakthrough in the field of 3D human body reconstruction, bringing new development directions and application prospects to the field. Reconstructing animatable 3D human bodies from a single image has been a highly challenging task, plagued by ambiguities in geometry, appearance, and deformation separation. Current state-of-the-art research mostly focuses on static human modeling, and these methods often rely on synthetic 3D scans for training, which greatly limits their applications in...

Alibaba Tongyi Lab has open-sourced ViDoRAG, a novel visual document retrieval and question answering system. ViDoRAG boasts impressive accuracy, achieving a remarkable 79.4% in benchmark tests. This system represents a significant advancement in the field of computer vision and information retrieval.

The Alibaba Tongyi Laboratory voice team announced that its open-source voice generation model CosyVoice has been upgraded to version 2.0. This upgrade marks significant progress in voice generation technology in terms of accuracy, stability, and natural experience. CosyVoice 2.0 achieves bidirectional streaming voice synthesis through the integration of offline and streaming modeling techniques, allowing for a first-package synthesis delay of up to 150ms, thereby significantly improving the responsiveness of voice synthesis.

On November 15, Alibaba Tongyi Lab launched the Code Mode, a feature that enables users to generate various applications through simple everyday language instructions, including mini games, data charts, websites, and resumes. Users can experience this new interactive method by visiting the Tongyi web version (tongyi.ai) and clicking on 'Code Mode' in the input box.

Alibaba's Tongyi Laboratory has released an AI animation project called Animate Anyone, which generates animated videos of characters using just a static image and skeletal animation. Cats dancing to 'Tie Shan Kao' have become a viral sensation online.

The Alibaba Tongyi Laboratory open sources the AI image generation fine-tuning framework SCEdit. The SCEdit framework supports fine-tuning for image generation tasks and demonstrates high efficiency in generation tasks. It achieves precise control in controllable generation tasks while saving training memory costs.